CLAIMS 
We claim: 

yVfacthod determining positional information about an anatqjrr 
ic^l feature within a patient's body comprising the steps of: 

inserting a nonsurgical instrument into the patient's bodyythe in- 
strument having\ means for transmitting an image out 9/ the pa- 
tient's body; 

designating cto anatomib^l feature of interest; 

transmitting an\mage of the\[esignated anatomist feature out of 
the patient's bod} 

determining positional information Xbowwh6yUCsignatcd anatomical 
feature of interest by using- image pro)/e/sini 



2. A method of detcrmini; 
tomical feature, as in Claim 
ignated by pointing with a 
visual target. 



positioh&l/Mbrmalion about an ana- 
where Vne anatomical feature is des- 
:cond/surgica\instrument having a 



3. A method of determining po&ti^nal information about an ana- 
tomical feature, as in Claim l/whercsihc ana tomical feature is des- 
ignated by manipulating a/computc\ generated graphics object 
displayed on a video screej/supcrimposc\on the imageNJxansmittcd 
by the first surgical instrument. 

4. A method of dclcmiining positional infor mation about \n ana- 
tomical feature, as/in Claim 3, where the computer generated 
graphic object is n^nnipulalcd by the use of a joystick mountccl^on 
a surgical instrunfcnl. 

5. A mcthodyof determining positional information aoout an ana- 
tomical feature, as in Claim 3, where the computer\ecncratcd 
graphic obfect is manipulated by the use of a force sensing device 
mounlcd/on a surgical instrument. 

6. A/ftiethod of determining positional information about an c^a- 
topfical feature, as in Claim 1, where the information is provided 

surgeon. 
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A method of detci mining positional infonnation about an ana-;, 
t^nffeql feature, as in Claim 6, where the information is provided tc 
th\ surgson in the form of synthesized speech. 

8. A \nethoa\pf determining positional information about an/ana- 
tomicA featurk as in Claim 6, where the information is provided to 
the surgeon in the form of tactile feedback. 

9. A method of determining positional information ah^ut an ana- 
tomical feature, as iirClaim 6, where the information is provided to 
the surgeon i\ the forrh of a computer generated graphics object 
superimposed o^j an imag^ obtained from the fi nonsurgical instru- 
ment. 

10. A method of determining positional information about an ana- 
tomical feature, as i\ Claim 8, \haffc the tactile feedback is pro- 
vided in the form of vibrations on /^urgje/l instrument held by the 
surgeon. 

11. A method of determining position/l\nformation about an ana- 
tomical feature, as in Claim V wherjz the Computer graphics objects 
are displayed in two dimensions. 

12. A method of determining nAitional information about an ana- 
tomical feature, as in Claim 9/\vh\c the compute^ graphics objects 
are displayed in three dimensions. 

13. A method of determining positiona\informa(.ion ab\ut an ana- 
tomical feature comprismg: 

inserting a first and/a second surgical instrument into the patient's 
body, each instrument having a means for transmitting an i\iage 
out of the patien/s body; 

obtaining a fyst image of the feature from a firstyantagc point us< 
ing the first /urgical instrument; 

obtaining^ a second image of the feature using (he second surgical 
instrument from a second vantage point, the second vantage point 
being/at a known position and orientation with respect to the first 
vantage point; 

l/cating the anatomical feature in both images; 
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e c miputiW the poriition of tho anatomical feature relative to th( 
vaatage points using positional information about the feature iri 
eachNmage^together with the known position and orientation o&ahe 
two vaiitage\oints with respect to each other. 

14. A method oMetcrmining positional information about an ana- 
tomical feature, as\in Claim 13, where the anatomical feature is lo- 
cated in at lea^t onesof the images by computer imago / processing. 

15. A method of o^terrenning positional information about an ana- 
tomical feature, as ih Cla^rn 13, where the first x^antage point is the 
position of the firstV surgical instrument, fencing one lens of a 
stereoscopic camera, aiul tKe second vantage point is the position 
of the second surgical instrument, Jbcing >ne position of the second 
lens of a stereoscopic earner 

16. A method of determining fWsiWnal information about an ana- 
tomical feature, as in Claim 13, wfete 

the first and second surgical/fnstruW^^ same, having a 

means for transmitting an image out o/a/ic patient's body, where 
the first image of the anatomical featurycy^sVbtaincd by placing the 
surgical instrument at tbe first vantage pon\tk 



and 



the second image of the anatomical feature is obtained by moving 
the surgical instrument to the second vantage point. 

17. A mctfiod of determining positional information about an ana- 
tomical feature, as in Claim 13, in which the first image i^obtaincd 
from sr; first surgical instrument placed at the first vantage point and 
the Second image is obtained from a second surgical instrument al 
Wy6 second vantage point, both surgical instruments having mc^ns 

» r transmitting images out. of the patient's body. 

18. A method of controlling the position of a surgical instrument, 
inside a patient's bodjMhc comprising steps of: 

inserting a first surgical instrument into the patient's body, the in- 
strument having a means for: transmitting an image out of the pa- 
tient's body; 
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designating an anatomical feature of interest; 

transmitting an image of the designated anatomical feature out of 
the patient's body; 

determining precise 3D positional information about the designated 
anatomical feature of interest relative to the first surgical instru- 
ment; 

using the positional information to reposition the first^stfrgical in- 
strument to a desired positional relationship relative to the ana- 
tomical feature. 

19. A method of controlling the position of a surgical instrument 
inside a patient's body, as in Claim 18, where the positional infor- 
mation about the feature of interest relative to the first surgical in- 
strument is obtained by means of image processing. 

20. A method of controlling the position of a surgical instrument 
inside a patient's body, as in Claim IS, where the positional infor- 
mation about the anatomical feature of interest relative to "the first 
surgical instrument is obtained by manipulating a graphics object 
superimposed on an image of the anatomical feature. 

21. A method of controlling the position of a surgical instrument 
inside a patient's body, as in Claim 18, where the positional infor- 
mation is used to reposition a second surgical instrument. 

22. A method of controlling the position of a surgical instrument 
inside a patient's body, as in Claim 18,'furthcr comprising steps of: 

designating a desired position of an anatomical feature relative to 
images transmitted out of the patient's body by the first surgical 
inst.ru mcnt; 

moving the first surgical instrument to a vantage point from which 
the designated anatomical feature is at the desired position in im- 
ages transmitted by the first surgical instrument, the first surgical 
instrument remaining at a constant distance from (he designated 
anatomical feature. 

23. A method of controlling the position of a surgical instrument 
inside a patient's body, as in Claim 18, further comprising steps of: 
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designating a desired direction of motion of an anatomical feature 
relative to images transmitted out of the patient's body by the first 
surgical instrument; 

moving the first surgical instrument so that it remains at a constant 
distance from the designated anatomical feature while causing the 
motion of the designated feature in images transmitted from the 
first surgical instrument to move in the desired direction. 

24. A method of controlling the position of a surgical instrument 
inside a patient's body, comprising steps of: 

inserting a first surgical instrument into the patient's body, the in- 
strument having a means for transmitting an image out of the pa- 
tient's body; 

designating an increment of motion along an axis of view of the first 
surgical instrument, the axis defined by a line from the vantage 
point of the surgical instrument to the point on the patient's anat- 
omy that appears in the center of the image transmitted by the first 
surgical instrument; 

moving the first surgical instrument by the designated increment of 
motion along the axis of view, so that the point on the patient's 
anatomy appearing in the center of the image remains unchanged. 

S^5. A system for pos i tioning a surgical instrument relative to a na - 
tietvt/s booyscomprising: 

a roboticNi^nipuI^Uir having at least one controllcd^grcc of free- 
dom; \ 

a control means fone^iUrolIinjN^ motions; 

instrument holding mcansl^' J^k^ fust surgical instrument 

to the manipulator; 

a surgeon input nprfns permitting the surgcoiiHo specify desired 
motions of the stffgical instrument to theXontrol mc>Kis, where said 
input mcanyiuc mounted on a surgical instrument. 

26yX : system for positioning a surgical instrument relative to *i pa- 
✓tfent's body, as in Claim 25, in which \ 
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' the mboLte manipulator hon a romoto contor of motion distal to the - 
manipulator mefch^nism; 



the instrument holding 
that the point at whi 
tient's 



bo< 



lanism. 



liQld-th^TTrst surgical instrument so 
surgical instrument enters the pa- 
ocated at the centeikpf- motion of the manipulator 



27. A method of controlling the position of a surgical instrument 
inside a patient's body, comprising steps of: 

inserting a first surgical instrument into the patient's body, the in- 
strument having a means for transmitting an image out of the pa- 
tient's body; 

transmitting an image out of the patient's body; * 

displaying the transmitted image on a video screen; 

manipulating a computer graphics object superimposed on the video 
screen to designate a view of an anatomical feature; 

moving the first surgical instrument to a vantage point from which 
an image comprising the designated view may be obtained. 

^Si IV method of creating on image of an anatomical featine wijjjifi 
a patient's body comprising the steps of: 

inserting a uV^l surgical instrument into the paticnt's^rody, the in- 
strument havings^ means for transmitting imagc^out of the pa- 
tient's body; 

transmitting an image ouKof the patient body; 



creating a wide-angle image oN} 
patient's body as it would a[ 
surgical instrument; 



matgmical feature within of the 
ant a tic point of the first 



replacing a porticj 
lure with an imrf 



of the wide-angle image 



gc transmitted by the first sui£ 



ihe anatomical fca- 
instru mcnt. 



:lhod of creating an image of an anatomical fcW^c within 
dent's body, as in Claim 28, in which the widc-anglcHniagc is 
iputer-graphic rendering of the interior of the patient's B^dy. 
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frOHA method of creating an image or an aualumical featu i e within 
aNoatient's body, as in Claim 29, in which the wide-angle image/is 
produced from at least one image transmitted from the interior of 
the p# Rent's body. / 

/ 

31. A n^Qthod of creating a stereoscopic image of an anatomical 
feature whin a patient's body comprising the steps of: ./ 



inserting a fr«t surgical instrument into the patient's /body, the in- 
strument havhj^ a means for transmitting images /ut of the pa- 
tient's body; 



obtaining a first in\ge of an anatomical feature/as seen from a first 
vantage point; 

placing the first surgicA instrument at a second vantage point at a 
known displacement relative to the first vantage point; 

transmitting a sequence of ^oncKmagcs y out of the patient's body, 
as seen from the second vant^</p/irfl; 

presenting the first image as m<rwc\v to one eye and the sequence 
of second images as the vie\y l^ofi^er eye in a stereoscopic viewing 
system. 

32. A method of creating /a stereoscopic image of an anatomical 
feature within a paticntV body, as in Cftnm 31, in which the first 
image is a computer-graphic rendering of\thc interior of the pa- 
tient's body. 

33. A method of (/eating a stereoscopic ima$fcof an anatomical 
features within a patient's body, as in Claim 31, ifWhich the images 
displayed comprise computer-graphic renderings oKcdgcs extracted 
from the images transmitted from the inferior of Iheuoalicnt's body. 



34. A systpin for positioning a surgical instrument rcl&rivc to a pa- 
tient's bocfy, as in Claim 25, in which the said surgeon uy\ul means 
comprisc/a joystick. 

35. AC system for positioning a surgical instrument relative to\a pa- 
tients body, as in Claim 25, in which the said surgeon input m^ans 
comprise a force sensing clement mounted on a surgical instrument 
rcld by the surgeon. 
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tient's body, as inX^aim 2^, in which the said^ui^eOTTl^ 
are mounted on a suVgjofl^^ to be inserted into 

the patienTsJaodA^ means being mounted on the 

TrTofthe instrumpt/t whibkremains outside the patient's bod}'. 
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